o 



X 



Order Reduction of Optimal Control Systems 



o 
o 

p ■ Igor Borovikov 



September 6, 2004 



Abstract 



The paper presents necessary and sufficient conditions for tfie or- 
der reduction of optimal control systems. Exploring the correspond- 
ing Hamiltonian system allows to solve the order reduction problem 
in terms of dynamical systems, observability and invariant differential 
forms. The approach is applicable to non-degenerate optimal control 
systems with smooth integral cost function. The cost function is de- 
fined on the trajectories of a smooth dynamical control system with 
unconstrained controls and fixed boundary conditions. Such systems 
Q>^ ■ form a category of Lagrangian systems with morphisms defined as 

. mappings preserving extremality of the trajectories. Order reduction 

I is defined as a factorization in the category of Lagrangian systems. 

! Keywords: optimal control, order reduction, Lagrangian systems, Hamil- 

^ ' tonian systems, factorization, decomposition, hierarchical control. 



1 Introduction 

The invariance in nonlinear control theory allows to approach and solve many 
important problems in an effective way. In particular, the invariance of 
dynamical control system with respect to the action of Lie group or Lie 
algebra allows order reduction by factoring out a system of smaller dimension. 
The review [16^ and monographs |T3], [12] present the current state of the 
art in this area. 

The study of invariance in optimal control (like in classical works |T3], 
[IHj or in recent publications [TT], (TH]) can be built on the results of classical 
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mechanics PP, j2]. This places the geometric approach to optimal control 
into the rich context of Hamiltonian mechanics and symplectic geometry. 

Different generalizations of the symplectic geometry allow to study wider 
range of symmetries of optimal control systems. In the recent work [TT] an 
optimal control system is treated as a Hamiltonian system on the correspond- 
ing presymplectic manifold. The symmetries of optimal control system are 
symplectic (when considered on a special symplectic subspace) actions of Lie 
group that leave both dynamical system and Lagrange function invariant. 
It is shown that such symmetries allow to reduce the order of the optimal 
control system. 

A more general point of view, based on theory of categories and theory of 
decomposition, allows to formulate the problem of order reduction in terms of 
general factor- and sub- objects (see for review of theory of decomposition 
for control systems). 

In JU] the order reduction of a smooth variational problem 



was studied in categorial framework. Variational systems form a category 
with morphisms preserving extremals. The extremals are solutions of the 
corresponding Euler-Lagrange equations. These equations form a dynamical 
system, which can be studied and reduced using general geometric methods. 
Solving the inverse problem of variational calculus allows to rebuild the re- 
duced variational system, when it exists, from the corresponding dynamical 
factorsystem. The work ^HI presents necessary and sufficient conditions for 
order reduction (factorization) of variational systems. 

One of the advantages of the categorial framework is that it allows to 
pose and solve the order reduction problem in the most general and complete 
way: the results of fUl cover all factorizations in the category of variational 
systems with morphisms preserving extremals. 

Here we will define a more general category of Lagrangian systems that in- 
cludes variational systems from [TU] as a sub-category. The objects of the new 
category are optimal control systems with smooth integral criterion, smooth 
dynamical control system and unconstrained controls. Morphisms in the 
category of Lagrangian systems are also defined as mappings preserving ex- 
tremals. Pontryagin's maximum principle allows to convert Lagrangian sys- 
tem into corresponding Hamiltonian system. We will define a new category 
of Hamiltonian systems with morphisms that may not necessarily preserve 
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underlying symplectic structure. That will allow to study factorizations of 
Hamiltonian systems using methods for general dynamical systems. Finally 
we will show that factorizations of Hamiltonian systems and Lagrangian sys- 
tems are corresponding to each other provided that observability condition 
for Hamiltonian factorsystem is satisfied. 

The main results of this work were announced in and [7j. 

2 Order Reduction as Factorization 

The problem of order reduction could be approached for each particular 
type of mathematical objects individually. However we can study it in a 
more uniform way by placing it into the categorial framework where order 
reduction can be treated as factorization in the appropriate category. 

For a brief informal illustration we will consider factorization of smooth 
dynamical systems. Smooth dynamical systems will form a category DS if 
we define morphisms - mappings of the dynamical systems into each other. 
A natural morphism is a diffeomorphisms from one dynamical system into 
the other dynamical system that maps trajectories of the original dynamical 
system into the trajectories of the image system. Factorization is a special 
morphism that does not introduce anything additional to the factor object, 
which could not be derived from the original object. A morphism in category 
DS defines a factorization if it is a surjective submersion (mapping onto of 
the full rank). A factor system in this case is the dynamical system on the 
image (factor) space. Any trajectory of the factor system has its inverse 
image - a set of trajectories of the original system. Also all trajectories of 
the original system map into some trajectories of the factor system. It is 
well known that such systems are described by /-related vector fields and 
provide the classical example of order reduction. Thus the order reduction 
of dynamical systems can be naturally described in very general terms of 
factorization. 

A formal definitions for this approach could be derived from theory of 
structures [S] or, equivalently, from theory of categories 0. For in depth 
discussion of theory of decomposition in application to control systems see 

In this paper we will apply categorial approach to the order reduction 
problem for optimal control systems. 
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3 The Category of Lagrangian Systems 



We will consider optimal control system formed by a smooth control system 
and an integral cost function: 



where q is an n-dimensional vector of phase variables and u is an m- 
dimensional vector of controls. The vector of control u is not constrained, so 
u G -R™. We will call such systems Lagrangian systems, because (under the 
appropriate conditions) the optimal control problem ()1I2|) with fixed bound- 
ary conditions is equivalent to Lagrange variational problem. The equivalent 
Lagrangian variational problem can be obtained by eliminating controls u 
from both and (j2I), then transforming |21 to the implicit form -F(g, q) = 0. 
Detailed definitions follow later. 

We will assume that the optimal control system ^ defines a field 
of extremal solutions. An extremal solution for (^Q |2I) is a curve 7(t) = 
{q{t),u(t)) such that it satisfies and the functional (jT]) achieves on 7(t) 
an extremal value within the class of the curves with fixed boundary points. 
As usually, extremals are not necessarily optimal curves: extremality means 
that the curve has vanishing conditional variations of the functional in its 
vicinity. 

We will be looking for an optimal control system of the same kind but of 
a lower order (a problem of order reduction or factorization): 



such that there exists mapping y = y{q,u),v = v{q,u), which maps 
extremals of (jH |2I) to the extremals of IH) . 

In this paper we will derive the necessary and sufficient conditions for 
the factorization of optimal control systems (m21)- We will use Pontryagin's 
Maximum Principle to transform the optimal systems into Hamiltonian sys- 
tems. Hamiltonian systems will allow for an intuitive geometric approach to 
the problem of factorization. Finally we will translate the results obtained 




(1) 
(2) 



<i = f{(i,u) 




(3) 
(4) 



y = F{y,v) 
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in the terms of Hamiltonian systems back into the domain of the original 
optimal control systems. 

Everywhere we assume smoothness an locality: all manifolds are open 
simply connected regions of i?", all functions are smooth (have as many 
derivatives as necessary), so we drop adjectives "smooth" and "local" in most 
cases. We use Einstien's convention for summation: terms with repeating 
subscript and superscript index automatically sums. 

4 Factorization of Hamiltonian systems 

A Hamiltonian system is a dynamical system generated by the gradient flow 
of a Hamiltonian function defined on a symplectic manifold. More formally, 
a triplet HS = {M,uj^,H) defines a Hamiltonian system on a symplectic 
manifold M, dimM = 2n, with the symplectic structure uj^ and Hamiltonian 
function H : M ^ R. 

A Hamiltonian system HS defines canonical equations in the form: 

z = IdH{z), zeM (5) 

where / : TM —>■ T*M is the isomorphism induced by the symplectic 
structure. We will also use HS to denote the canonical equations (0). 
In local canonical coordinates {p, q) on M, we have: 

oj'^ = dpi A dq\ i = l,n (6) 
and the system (jSj) has the form 

p = —dH/dq, q = dH/dp 

Let HS' = {N,uj'^,G), dimN = 2n be another Hamiltonian system and 
let : M — i> be a smooth (not necessarily symplectic) mapping. If {p, q) 
and (x, y) are canonical coordinates on M and A^, then we can write in 
coordinates as x = x(p, q),y = y{p, q). 

Definition 1 Mapping (p : M —>■ N is called a morphism of Hamiltonian 
systems if for any solution z(t),t G [0,T] of the system HS its image under 
the mapping cf) is a solution of the system HS' on the interval t G [0,T]. 
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Using categorial notation wc will write : HS — > HS' for the morphism 
(j) of Hamiltonian systems HS and HS'. 

The underlying symplectic structure does not participate in the definition 
of the morphism directly. So, if (j) '■ HS — > HS' is a morphism, then by 
"erasing" symplectic structures o;^ and uj'^ from HS and HS' respectively 
we will obtain a morphism of general dynamical systems. This observation 
leads to: 

Proposition 1 Let HS = {M,uj^,H) and HS' = {N,Zj'^,G) be Hamilto- 
nian systems, and let (f) : M ^ N be a smooth mapping, then the following 
conditions are equivalent: 

1. 4> is morphism of Hamiltonian systems HS and HS' 

2. vector fields of the systems HS and HS' are (p-related 

If we denote by /' the natural isomorphism T*N — > TN induced by uJ^, 
then the relation between vector fields of the Hamiltonian systems HS and 
HS' will have the form 

I'dG = (t)JdH 

Using Poisson bracket {)p^q on M we can write the same relation in canon- 
ical coordinates on M as 

dG/dxi = {H, y%,g, -dG/dy' = {H, (7) 

We will focus on the case when dimN < dimM and the mapping (p is 
onto and of full rank, which corresponds to a factorization of Hamiltonian 
systems. Let's find when (f) : M ^ N maps a Hamiltonian system HS from 
(M, cj^) into a Hamiltonian system on {N,uj'^). The symplectic form Zj"^ on 
the factor space (A^, aJ^) has to be an invariant of the factor-system by the 
definition of the Hamiltonian system. The form — (j)*cJ^ on M is induced 
by (f) from the form uj'^. If the canonical coordinates (p, q) and {x, y) on both 
spaces arc fixed, then (j) has the form x — x{p, q),y — y{p, q), and we obtain 
a coordinate representation 

^ dxi{p,q) A dy\p,q), i^l,m. 
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Proposition 2 Let (p : M ^ N he a surjective submersion. The projection 
(p^IdH of the field IdH from M to N exists and is a Hamiltonian vector field 
on {N,uj'^) iff 1-form ijdH^^ is closed. 

Here iah denotes the internal product of a vector field a and a form h. 

Due to the locality, a closed form is automatically exact. That means it 
actually is a differential of some function on M and, as we will show, on N 
as well. 

Note again that the fact that the vector field on M is Hamiltonian is not 
used anywhere. 

Proof. Necessity. By assumption (p^IdH = I'dG, where I'dG is a Hamil- 
tonian field on (iV, cJ^). Consider function G = G o 0, which is defined on M. 
The following is valid for G: 



These equalities follow from the chain rule applied to Go0 and the equiv- 
alent transformation of a gradient 1-form into a vector field on a symplectic 
manifold. 

To receive the same result in coordinates, let's unfold imh^^ in the coor- 
dinates (p, q) on M: 



Calculating the inner product in the right hand part we will get: 

iidHdxi{p, q) A dy\p, q) = {y\p, q), H)p^gdxi{p, q) - {xi{p, g), H)p^gdy\p, q) 

The right hand part here is the full differential of G{x{p,q),y{p,q)) be- 
cause of 0-relation of the vector fields expressed by ((Tj). 
Sufficiency. 

The equality dG = iidH^"^ is equivalent to the fact that the gradient dG 
can be linearly combined from the gradients of the independent mapping 
functions x{p,q) and y{p,q)- In coordinates: 



dG = d{G o(j)) = 4,*dG = 4>*irdGUJ^ 



iidH^^ = iidHdxi{p, q) A dy\p, q) 



dG 



(l/',^)(p,^) 



dxi 



{xj,H)(^p^g) 



dy^ 



(8) 



dpk 
dG 



dpk 
dxi 
dq^ 



dpk 
dqf" 



(9) 



dq^ 
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where k = l,n. 



Because of the hnear dependence of the gradients we have G = G o 
with some function G : N ^ R. Hence dG = (f)*dG and we have a new 
equahty (j)*dG = iidH(p*'^^'^- Since has full rank the last equality implies 
that dG = i^*i(iH^'^- From this follows that I'dG = (p^IdH, i.e. the gradient 
vector fields are 0-related. 

The system (jH} , © can be viewed as a system of linear algebraic equations 
Ah = g with the matrix 



with the right hand part g = [d G/dp, OG/dqY ■ 

Both vectors [(y, — (x, and [dG/dx, dG/dyY satisfy the sys- 

tem: the first one is the solution by assumption and the second one as the 
result of the chain rule differentiation. The matrix A is of a full rank and the 
system is overdetermined. Hence the solution, if exists, is unique. This proves 
that (|7j) holds under our assumptions, which is equivalent to the 0-relation 
of the corresponding vector fields. The proof is complete. 

Using formula Lx = ix ° d + d o ix ioi Lie derivative Lx along vector 
field X, and the fact that dVL^ = 0, we can get an equivalent proposition: 

Proposition 3 A vector field v on M maps onto a Hamiltonian field on 
{N, cJ^) under surjective submersion (p : M ^ N iff 2-form Q'^ = 0*ZZ;^ is an 
invariant of 1-parametric Lie group generated by the vector field v. 

Proof. Using infinitesimal criterion of the invariance we can conclude that 
L^Q"^ = 0. Next, expanding this using the formula Ly = i^o d + doi^^ we get: 
d o i^Q'^ = because dQ"^ = by definition of symplectic form. This reduces 
Proposition El to Proposition |21 

Corollary 1 If (p : HS HS' is morphism of Hamiltonian systems then 
the function G = Goip, where G is a Hamiltonian of HS' , is the first integral 




dx/dp dy/dp 
dx/dq dy/dq 



ofHS. 



Proof. The corollary follows from the chain of equalities: 



{G,H) 



IdH{dG) = lMH<P*dG = {iMHf<P*^'^ = 
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Here the first equality is by definition. The second one is an expansion of 
dG. The third one is due to Proposition 01 The last equality holds because 
of the skew symmetry of 2-form 0*^17^, which is symplectic on A^. 

Remarks. In short this section says that we can reduce the order of a 
Hamiltonian system by projecting a general vector field and then converting 
the reduced dynamic system into the Hamiltonian form. The problem of 
recognizing a Hamiltonian system in a general dynamic system was studied 
in geometric mechanics (see [12] for linear quadratic case). The Hamiltonian 
form always exists locally whenever we can present 2m — 1 independent first 
integrals, which is always possible in the vicinity of a regular point |3]. We 
covered the subject in sufficient details mainly to establish the framework 
for the following sections. Also note that the propositions in this section can 
be easily generalized for the global case, but we keep it local for consistency 
with the later discussion. 

5 Factorization of Optimal Control Systems 

Here we introduce a category of Lagrangian systems to set up a framework 
for factorization of optimal control systems. Then we are going to establish 
a connection between factorizations in categories of Lagrangian and Hamil- 
tonian systems. 

Definition 2 A Lagrangian system LS is a triplet {M,CDS,L), where M 
is a manifold, dimM = n, CDS is a controllable dynamic system on M, and 
L is a function M x U R. 

By dynamical control system CDS' in the definition |21 we understand a 

system: 

q' = f{q,u), qeM,i=T~ii 

where the vector of control u & U = is unconstrained. 

A curve 7 : [0,T] R x U (or, in coordinates, 7(t) = {q(t),u{t)),t G 
[0,T]) is called a solution for CDS if it satisfies the equation dq(t)/dt = 
f{q(t),u(t)) for Vt G [0,T]. Also we will call such curve admissible. 

The function L : M x U —^R from the definition |21 defines a functional 
£(7) on the set of all admissible curves by the formula: 
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£(7)= / L{q{t),u{t))dt 
Jo 

Solutions of a Lagrangian system are the extremals of ^2(7) in the class 
of curves with fixed boundaries. 

Definition 3 A solution 7(t) = {q{t),u{t)) of Lagrangian system LS = 
(M, CDS, L) is a curve providing a local extremum to the functional C on 
the class of admissible curves with fixed boundary points. 

Let LS' = {N, CDS', Q) be another Lagrangian system, such that: 
dimN = V, CDS' has the form y = F{y, v), v E V,V = and Q = Q{y, v). 
Consider mapping : M x U — > x V^, or in coordinates: y = y{q,u),v = 
v{q,u). 

Definition 4 A mapping : M x U —^NxVis called a morphism of 
Lagrangian systems from LS to LS' if it maps solutions of LS into solutions 
ofLS'. 

In other words, if 7 = jit) is a solution of LS then 7' = ^ o 7, Y{t) — 
{y{q{t),u{t)),v{q{t),u(t) j) is a solution of LS'. We will denote a morphism 
of Lagrangian systems by the same mapping symbol "if : LS — > LS'. We will 
be interested in morphisms that are onto and of full rank (factorizations) of 
Lagrangian systems. 

Let Pidq^ be the standard 1-form on T*M. 

Definition 5 A function 7i{p,q,u) = Pif'^{q,u)—L{q,u) defined on {T* M) x 
U is called Pontry agin function of the Lagrangian system LS — {M, CDS, L). 

Wc disregard singular systems, so Pq in a more general Pontryagin func- 
tion Pif^q, u) — PoL{q, u) is never vanishing and we always have pq = 1. 

Definition 6 A Lagrangian system LS is called non- degenerate if it satisfies 
the following conditions: 

1. A system of nonlinear algebraic eqations dH/du^ = 0, k = l,m can be 
resolved with respect to u, the soluition u — h{p, q) is unique and the 
mapping u : T*M U is smooth. 
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2. The matrix fu has full rank: 



rank 



df 



where i = l,n and k = l,m. 



The mapping u described above is the optimal synthesis for the optimal 
control system. 

Note that m < n for a non-degenerate Lagrangian system (the dimension 
of control space does not exceed the dimension of the phase space) . 

From here we will consider only non-degenerate Lagrangian systems. 

The correspondence between control variables u and dual variables p es- 
tablished by optimal synthesis is not one to one in case m < n. Because of 
that we need the following definition of observability. 

Definition 7 A function S : T*M ^ R is called observable in LS if there 
exists a function : M x U ^ R such that the following diagram commutes 

A 



T*M 



M xU 





R 



where A = n x u is morphism of fiber bundles n : T*M M and 
n' -.M xU ^ M. 

In other words, the definition requires that S{p,q) = '^{q,u{p,q)) for 
observable in LS function 5*. In the linear case this definition corresponds 
to the observability defined in 0. 

The set of observable in LS functions will be denoted as J^o{LS), or JF^ 
for brevity, when no confusion can happen. 

We also need to define observability for morphisms of the Hamiltonian 
system derived from a Lagrangian system. Let HS' = (T*N, uJ^, G), dimN = 
u he a. Hamiltonian system defined on T*N with a natural symplectic form 
cJ^ = dxi A dy^ where {x, y) are canonical coordinates on T*N . Let : HS — 
HS' be morphism. In coordinates x = x{p, q),y = y{p, q)- Let vr : T*N 
be a natural projection and L^ be Lie derivative along vector field h = IdH 
defined by HS = {T*M, uj^,H). 
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Definition 8 Mapping (f) : T*M T*N is observable in LS if functions 
7f o and LhW o are observable in LS. 

If (f) : HS — > HS' is a factorization of Hamiltonian systems and is 
observable in LS then HS' is called an observable in LS factorization of HS. 

Also we will need a rather technical definition of a regular point that 
would allow us to facilitate the proof of the main result later. 

Definition 9 A point {qo, uq) & M xU is called a regular point of LS if the 
set R — 7f~^(go) x ^er„(,A (in coordinates: R — {{p, q) e T*M : q — qo,uo — 
u{p,qo)}) does not contain singular points of HS and the rank of the set of 
the functions Lf^q\i — 0,n,s — 0,1,... is constant in the vicinity of each 
point in R. 

This type of regularity will turn out to be quite natural, but we will see 
that only later in the discussion. 

To show that the regular points do exist, consider Lagrangian system 
corresponding to a linear-quadratic optimization problem. One can show 
that regular points exist not only for linear-quadratic systems. Also it is 
possible to somewhat relax requirements for the regular points but for the 
price of much more technicalities that we would need to deal with. So we 
presented a simpler but more restricting version of regularity. 

The final preparation before formulating the main result of the theory of 
factorization of Lagrangian systems is the following definition. A Lagrangian 
system LS' is a factor system for LS' iff there exists morphism : LS — > LS' 
which is a surjective submersion. 

Proposition 4 Let LS and LS' be Lagrangian systems. Let HS and HS' be 
corresponding Hamiltonian systems. Then the following two conditions are 
equivalent: 

1. LS' is factorization of LS 

2. HS' is observable in LS factorization of HS 

Proof. (2) =^ (1). Given a morphism of Hamiltonian systems : HS — > 
HS' we will build the corresponding morphism ip : LS — > LS', which, by 
definition, is a mapping xjj : M x U N x V that maps extremals of LS 
into extremals of LS'. 
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The first half of the morphism mapping functions can be easily obtained 
from the observabihty assumption: y = y{p, q) = y{q, u{p, q)), since y{p, q) is 
observable in LS. Hence on the extremals of LS we have y = y{q, u). 

In coordinates, if 7(t) = {p(t),q{t)) is a solution of HS then 0(7(t)) = 
{x{t),y(t)) is a solution of HS' which corresponds to an extremal ^{t) = 
{y{t),v{x{t),y{t)) in LS' where v{x,y) is the optimal synthesis in LS'. 

From observability of (p we have Lhy^ = F^{q, u{p, q)) with some functions 
F*, i = 1,1/. Here u is optimal synthesis in LS. 

Since vector fields of HS and HS' are 0-related, we have equalities: 
F^{q,u) = F\y{q,u),v),i = 1, u, which hold on the trajectories of HS. The 
system LS' is non-degenerate, thus we can resolve these equations. Indeed, 
these equations are consistent on the trajectories of HS with respect to v: 



It is easy to see that y = y{p, u) and v = v{q, u) are defining a morphism 
of the Lagrangian systems. If {q{t),u{t)) is an extremal of LS, then there 
exists p{t) such that {p{t),q{t)) is a solution for HS. Morphism of Hamil- 
tonian systems maps this solution into a solution {x(t),y(t)) of HS'. This 
solution defines an extremal {y{t),v{t)) with an optimal synthesis v{t) = 
v{x{t),y{t)). But on the trajectories of HS holds (finjl . so v{x{t),y{t)) = 
v{q{t),u{p{t), q{t))) on the solutions of HS. This means that the mapping v 
gives the same function of time as the optimal synthesis v, so the extremal 
of LS was mapped into an extremal of LS' . 

(1) ^ (2) Given morphism ip : LS LS' of Lagrangian systems we need 
to build morphism : T*M — > T*N of Hamiltonian systems from HS into 
HS' and show that is observable in LS*. 

The first half of the morphism components is obvious: y{p, q) = 
y{q,u{p,q)) where u is the optimal synthesis and y{q,u) is the first part 
of the morphism ip: MxU-^NxV of the Lagrangian systems. These 
functions are obviously observable. 

If 7(t) = {q{t),u(t)) is an optimal trajectory in LS then its image 7' = 
{y{q{t),u(t)),v{q(t),u(t))) is an extremal, hence an admissible trajectory of 
LS'. From this follows that on the trajectories of HS holds 



V = v{q, u) 



(10) 



d_ 
di 



y{q,u) = F{y{q,u),v{q,u)))) 
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Thus the functions Lhy'^ are observable. The observability of the mor- 
phism is estabhshed and from now on we will write for brevity y — y{p,q), 
Lhy = F{p, q), collapsing the longer expression via u{p, q). 

Let V = v{x,y) be an optimal synthesis in LS'. By assumption the 
equality F{y{p,q),u{p,q)) = F{p,q) holds whenever {p{t),q{t)) is a solution 
of HS. When this is the case, there exists a function x{t) such that together 
with y{p{t),q{t)) it satisfies HS'. Under these conditions, our task is to find 
unknown components x{p, q) of the mapping : T*M T*N while we know 
part of it y{p, q) so that (p will be a morphism from HS to HS'. The Lemma 
from the next section claims that such functions x{p, q) exist. Proving the 
Lemma will finish the proof of the Proposition. 



6 Existence of the Morphism 

The previous section left us with a partial mapping of Hamiltonian systems 
that we need to extend to morphism. It turns out that the Hamiltonian 
structure is not important for that so we will consider general dynamical 
systems 



= ^i(x)J = l,m (11) 

and 



y' = ?7^(y,z),i = l,ni (12) 
z'^C\y,z),k^T;Tr2 (13) 



They define vector fields 



5- = >;•(!/. ^)|7 + C'te,^)^ (15) 



where j = l,m,i = 1, ni, k = l,n2 and m > n = ni + n2 
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The fields X and Y are defined in Ui G BJ^ and U2 G -R" respectively. 

We assume that there exists a mapping y = y{x) such that for each 
trajectory x(t) of the field X there exists a trajectory {y{t), z{t)) of the field 
Y such that ?/ maps x{t) onto the corresponding components of the image. 
That means that if x{t) is a solution of the system (fTT|) and y(t) = y{x{t)) is 
provided by the mapping y{x), then there exists z{t) such that {y{x{t)), z{t)) 
satisfies the system (fT^ IT^ . 

As in Definition El we will call a point xq € t/i a regular one if xo is 
a regular point for the field X and the rank of the set of the functions 
Lxd^o)y s = 0, 1, 2 = 1, m is constant in the vicinity of xq. 

Lemma 1 Under the described assumptions in the vicinity of the regular 
points of X and Y there exists a mapping z{x), not necessarily unique, such 
that the pair {y{x), z{x)) is a morphism of dynamical systems from HI]) to 



The key observation for proving the Lemma is that the existence of a 
complete mapping from (|TT| to ()12| fT3|l is equivalent to the existence of a 
solution of a PDE system with identical principal part. This kind of systems 
was explored by V.I.Elkin in ^2] and the proof of the Lemma relies on his 
results. 

Proof. Since for each solution x{t) of there exists some solution 
{y(t), z{t)) of ()12|13|) . we can conclude that there exists a mapping z = z{x) 
such that F : X — {y,z),y = y{x), z = z{x) maps initial conditions Xq of the 
solutions of (fTT|) into initial conditions {yo,Zo) of the solutions of (|12I13|) . 

At this point we can't claim yet that F is the morphism we are looking 
for since we need to show that it will differentiate properly along the field 
X to map X into Y. To show that we can differentiate y{x) part of the 
mapping along both fields. By the assumption the derivatives of y have to 
be the same along both fields since y = y{x) maps solutions into a partial 
solutions. That will result into a system of algebraic equations with respect 
to y\ z^: 



mm- 



y' = y\x) 



(16) 
(17) 



where ^ = 1, ni, k = l,n2 and s = 1, 2, .... 
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The graph of the mapping F is a set {{x, y, z) ^ Ui x U2 : y = y{x), z = 
z{x)} contained inside of the manifold M G f/i x U2, which is defined by the 
equations ([TBI ITTj) . The mapping F is defined for all x G f/i, so for each x 
there exists some solution {y,z) of (fT^ IT7|) . Thus dependent equations in 
the system (fT^ ITTj) have to be identities with respect to x. 

Next consider a regular point {y^, zq) = {y{xo), z{xq)) of the filed Y. In 
the vicinity of the point [xq, yo, zq) E Ui x U2 the rank r of the set of the 
functions 



l,ni,s 



1,2, 



(18) 



is constant. 

If the set is of the maximum rank r = ni + n2 then by the virtue of the 
implicit function theorem the equations (|161 ITTj) define a function z = z{x) 
that together with y = y{x) defines the required morphism of the dynamical 
systems. 

To finish the proof we have to consider the case r < ni+n2. The fields X, 
Y and Z = X + Y have no singular points inside the area of consideration. 
Thus they define a set of the first integrals. For the field Z we will have 
n + m — 1 first integrals which are independent functions in the area. The 
set of the integrals contain all the integrals I'^{x) 
and some functions J°(x, y,z),a 



1, n, such that: 



1, m 



1 of the field X 



det 



dy' 



where i = 1, ni, A; = 1, n2, rii + 77,2 



dz^ 



n. 



7^0 



We can add some of the functions J" to the set (fTHj) to make it of full 
rank n. Without loosing any generality we can assume that the functions 
used for that are J^(x, y, z), P = l,n — r. Let us add equations 



J'^{x,y,z) = If^ix), f3 = l,n-r (19) 

to the system ()l(i|17|l . The combined system pfjpiT^ im jl defines a manifold 
M' e M. If the manifold M" is defined by the equations (0, then M' = 
MOM". It is easy to see that the field Z is tangent to each of the manifolds 
M and M" , thus Z is tangent to M'. It is known from that such manifold 
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defines smooth functions = y^{x),z^ = z'^{x) satisfying a system of PDE 
with identical principal part: 



(20) 



(21) 



dx^ 



where j = l,m,i = l,ni,k = l,n2. But this system is exactly equivalent 
to the condition that the functions y = y{x),z = z{x) define a morphism 
from (fTT|) to (fT^ Uni) . This concludes the proof. 

Remark. Although the set (|T8|l contains infinite number of functions we 
can define the rank of this functions set with finite number of differentiations 
and calculations of determinant. That allows to reduce the system ()lfi| fTTj) 
to a finite one that contains only independent equations. 

7 Equations of Factorization. Building a Fac- 
torsystem. 

Let's denote J-'i{LS) (or, in a short form, J^i) the set of the functions on 
T*M observable in LS together with its first derivative along HS. Obviously 
^1 ^ -^0- Both conditions / G JFg and j ^ T\ can be expressed in terms of 
differential equations for /. 

Proposition 5 A Lagrangian system LS has non-trivial factorization iff 
there exist functions y\p, q) G J^i,Q{p,q) G J-'o,Xi{p,q),i = < n such 

that the functions y^{p, q),Xi{p,q),i = 1, z/ are independent and the following 
equation is satisfied: 



To prepare the proof we will use Cartan formula for Lie derivative to 
transform the equation (j^^ into its equivalent form: 



Liduixidy') = dQ 



(22) 



d{x,{y\H) 



Q) = iiduidxi A dy') 



(23) 
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Necessity. Let there exist a factorsystem LS' 



/ Q(y, v)dt extr 
Jo 

y = F{y,v) 



(24) 
(25) 



where y G N,dimN = v and v = v{x,y) is its optimal synthesis. Then 
the extremals of LS' are described by the equations: 



dT 

dxi 



v=v{x,y) 
Xi 



F\y,v{x,y)) 
dT 



dy^ 



v=v(x,y) 



(26) 
(27) 



Here T = XiF^{y,v) — Q{y,v) is Pontryagin function of the Lagrangian 
system LS'. By assumption we have the equality F''{y,v{x,y)) = {y\H)p^q. 
It follows from Proposition that there exists a morphism x = x{p, q),y = 
y{p, q) of the corresponding Hamiltonian systems. The Hamiltonian of the 
factor system in coordinates (p, q) is: 



G{p, q) = Xi{p, q){y\p, q), H)p^g - Q{y{p, q),v{x{p, q),y{p, q))) 

From Proposition (0) we have equality dG = iidnidxi A dy''). It immedi- 
ately leads to the equation (j^ . if we set: 

Q{p, q) = Q{y{p, q),v{x{p, q),y{p, g)))- 

It can be easily verified that G J^i and Q G JFg. 

Sufficiency. We assume that functions y^p, q) G JFi, Q{p, q) G JFq, Xi{p, q), 
i = l,u,u < n satisfy equation and that functions y\p,q),Xi{p,q),i = 
1, u are independent. Consider a function 

G = Xi{p, q){y\p, q), H)p^q - Q{p, q) 

and denote (?/*(p, g), H)p q = F{p, q). We will show that F = F o (p and 
Q = Q o (j), where is the mapping defined by {x{p, q),y(p, q))- 

From the condition (j^Hj) and Proposition Q follows that G = G o (p. 
Then, according to Proposition (0) on fields 0-relation, we have: 
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{y\p, q), H)p^g = g^i^iP, <l),y{P, l)) = F\x{p, q),y{p, q)) (28) 

Hence F = F oip. Because of that we have q)F'^{p, g) = B o 0, where 
= Q{x,y) = x^{x,y). Finally^from Q = Xi{p,q){y'{p,q), H)p^q - G = 
Bo0 — Go0we obtain that Q = Q o (p. 

Next we will consider independent functions = v''{x,y), k = l,fi such 
that = F''{y,v{x,y)). The number /i of such functions can be derived 
from 



rank 



dxidxj 



rank 



dF' V 



k n 



dv'^ dxj 



where i,j = 1, z/, /c = 1, /x. Since 



rank 



dv 



then 



rank 



dxi 



Having = F^{y^v) we can show that Q depends on x via v: Q = 
Q{y,v). From the definition of Q we see that Q = XiF\y,v) — G{x,y). 
Differentiation of Q reveals linear dependence of the gradients: 



dQ_ 
dx-i 



F^{y,v) + X, 



dG 



Qpi Qyk 



dv^ dxi dxn 



[Xi 



dv^ dxi 



Here the last equality follows from (j28|l . From the linear dependence we 
conclude that Q{x,y) = Q{y,v{x,y)). 

Now we can form a Lagrangian system: 



fT 

/ Q{y, v)dt — > extr 
Jo 

f = F\y,v), i 



(29) 
(30) 
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We will show that v = v{x,y) is the optimal synthesis for this system. 
The Pontryagin function for this system is: T{x, y, v) — XiF^[y, v) — Q{y, v). 
By construction T{x,y,v{y,v)) = G{x,y), thus 



dG dT 



dxj 



dxj 



'x,y,v) 



v=v{x,y) 



v=v{x,y) 9Xj 



On the other hand 
dT 



dx. 



(x,y,v) 



v=v{x,y) 



dG 

dxj 



= F^{y,v{x,y)) 



Comparing last two equalities we see that: 



dT 



dv 



di)^ 

v=v(x,y) dXj 







Since i)^ are independent functions of x, we can satisfy the last equality 
only if 



dT 



dv 



= 



v=v{x,y) 



But this is exactly the definition of the optimal synthesis as a stationary 
point of Pontryagin function. 

From the observability of F{p, q) follows observability of the synthesis 
v''{x{p, q),y{p, q))- To proof this consider: 

dF^ ,9m" 
dps dps 

with some functions Al{p^ q). Their existence follows from the observabil- 
ity of q). On the other hand 



dF^ dP^ dy' ^ dP^ dv'' 



dP^ : , , du"" dP^ dv'' 
-Bl{p,q)^ + 



dps dy^ dps ' dv'' dps dy^ " ' dps dv'' dps 

where again the existence of the functions ^^(p, q) follows from the chain 
rule for differentiation of a compound function and from observability of 
uKPi^) ^"^^ their derivatives. Combining all together we see that the gradi- 
ent dv'' /dp is linearly expressed via the gradients du°'/dp since the matrix 
[dF^ /du"'] is of the maximum rank. This proves observability of v in LS. 



20 



Thus we built a factor system from the solution of (j22j) and also we built 
a morphism into the factor system. This concludes the proof. 

We will call the equations from the Proposition (0) (and their equivalents 
(1221)) "equations of factorization". 

Note that calculating the outer derivative d on both sides of we get 
Lidnidx^ ^dui) = which is in agreement with Proposition |21 Also it is easy 
to verify that the identity morphism provides a solution for the equations 
of factorization ()23|) : x = p,y = q,Q = L, which transforms these equations 
into the identity: 

dH 

d{Pi^ L) =dH 

OPi 

Remark. A quite standard note is that systems with explicit dependence 
on time t can be reduced to the investigated stationary case. We can add 
a new equation t = 1 and a new pair of boundary conditions for the new 
variable t(0) = and t(T) = T. The only difference of the new variable from 
the rest is that its boundary conditions are always the same. This does not 
affect our reasoning which was for the fixed ends case anyway. Finally, a field 
of extremals remains a local object in this case too. 

Example 1. An optimal control system 



/ {qiUiU2 + qiq2)dt — > extr (31) 
Jo 

qi=Ui, q2 = U2 (32) 

has a factorization. This was shown by A.N.Chernoplekov in ^Oj- The 
system (jMl 1221) is especially well suited to show that the factorization theory 
developed here is quite natural and generalizes factorization of variational 
problems in [lOj. 

The Hamiltonian equations for the optimal control system (j31l32|) are: 



P1P2 , . P2 ,„QN 

Pi = + 92, qi = — (33) 
P2 = qi, 42 = — (34) 

The mapping {x = 2p2,y = q\) defines a morphism into the Hamiltonian 
factor system 
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The Lagrangian system that corresponds to this Hamiltonian system is 



rd^'' + ^y'^')dt ^ extr (35) 
Jo 2 6 

y = v (36) 

and the optimal synthesis isv = x. The conditions of observabihty in this 
case are satisfied automatically. The morphism of the Lagrangian systems in 
this case is 

y = qf, V = 2qiUi 

Also let's write down the equations of the factorization and check that 
they are satisfied: 

Here ()• denotes differentiation Li^h along the vector field of the original 
Hamiltonian system ()33l34j) . 

The morphism of the Hamiltonian systems in this example is essentially 
non-symplectic, meaning that there is no coordinate change that will make it 
symplectic. It is easily follows from the observation that for any two functions 
/i(?i,P2), /2(gi,P2) we have (/i, /s)^,^ = 0. 

It is also possible to verify that the Lagrangian system from this example 
does not allow any symmetries as defined in jTTj. To show that we will search 
for a vector filed in the form (see proof of Theorem 1 in fH]): 



~ d d d d 

C = 6(gi, 52)7^ + 6(?i,92)t^ + Ci(?i, 92,^1, M2)^ + C2(gi,g2, Ml, M2)- 



O I 1^/ o ' -blVIl) 1^) ""1) "'■^J n I -b^VIl) 1Z) "-11 "-^J rN 

aqi oq2 oui ou 
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If X is vector field defined by dynamical system ()32|). then invariance of 
Lagrangian system with respect to a field ^ is given in ^1] by conditions 
L^X = (invariance of the vector field X) and L^L = (invariance of the 
Lagrangian L{q,u)). 

Expanding these conditions into the system of PDE we obtain: 
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Ci = ui— + U2Tr- (37) 
oqi dq2 

C2 = Ml^ + ^^27^ (38) 

oqi dq2 

^i{uiU2 + q2) + 6^1 + giM2Ci + qiUiC,2 = (39) 

We can substitute Q into the last equation. Then we can break it into a 
system of equations by powers of ui^2 since the solution ^ does not depend 
on u. The resulting system 



6g2 + 6gi = o (40) 
6 + gi^ + gif^ = o (42) 

oqi dq2 

has only trivial solution. 

Thus the Lagrangian system in this example has no symmetries in terms 
of yet it allows order reduction within the introduced category of La- 
grangian systems. 

Example 2. A system 

/ ('?i'?2 + 7:u\)dt extr (43) 
JO / 

gi = g2 - Ml, q2 = qi + ui (44) 

offers another example of order reduction via factorization in the category 
of Lagrangian systems. 

One of the possible strategies of order reduction for this system is to sum 
up equations of the control system and eliminate Ui. Then we can integrate 
the resulting ODE, but that will result in introducing time t in the right 
part. 

However solving the equations of factorization will allow for more elegant 
order reduction. The solution that leads to a simpler system is 

X = qi-q2+P2-pi, y = P2-pi, Q = ]^{qi-q2+P2-pif-{p2-pif 
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The corresponding factor-system is: 



/ -{v^ - y^)dt ^ extr (45) 
Jo 2 

y = v (46) 



with the morphism 



y = Ui V = qi~q2 + Ui 
into the factorsystem. 

Example 3. The so called "horizontal decomposition" (see [16 ) can be 
achieved for the system: 

Jo ^2^^ " ^^^^ ~ 4^^ ~ 1^1)^^ ^^^"^ (47) 

gi=Ml, g2 = gi+M2+M3, g3 = ?2-M2+M3 (48) 

This system is equivalent to the pair of two independent factor systems: 

/ iym + -vl)dt ^ extr (49) 
Jo I 

y\ = y2, 2/2 = v\ (50) 

and 

rk^l-yDdt^extr (51) 
Jo 2 

m = V3 (52) 
The corresponding morphisms of the Lagrangian systems are: 



yi = qi, 2/2 = ui, vi = i(g2 + qs) (53) 
ys = -U2 V3 = ^(^2 - gs) (54) 
And the morphisms of their Hamiltonian systems are: 
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xi=pi, X2 = -{q2 + q3), yi = qi, y2 = -P2~'P3 (55) 

3^3 = ^(^2 - gs), 1/3 = P3 - P2 (56) 

8 Boundary Conditions, 

Constrained Control and Factorization 

In this section we will discuss how boundary conditions transform under 
factorization of Lagrangian systems. 

We will say that the Lagrangian system defines an optimal control prob- 
lem if we specify and fix some boundary conditions allowing to pose a fixed 
ends boundary conditions problem for the corresponding Hamiltonian sys- 
tem. As an example we will consider conditions g(0) = go, q{T) = qi. Under 
the factorization mapping they transform into boundary conditions in factor 
spaces T*N and N x V. The transformed boundary conditions define some 
manifolds where the trajectory of the factor system has to start and to end. 
Depending on the dimension of these manifolds we can end up with over-, 
well- or under- determined boundary problem for factorsystem. 

The over- and well-determinied cases are directly useful. If the boundary 
problem for the original system has a solution it is obvious that the factor 
problem is also solvable, even if it may appear overdetermined. Such factor- 
ization allows for classical hierarchial control when we can solve the factor 
problem and then extend its solution to the solution of the original problem. 
The discussion of such well-behaving factorization naturally falls into the 
framework developed in Y.N.Pavlovskii, V.I.Elkin [TE] and will be essentially 
the same as in the paper ^U] by A.N.Chernoplekov for the case of variational 
systems. 

The case of under-determined boundary factor problem is less obvious. 
Example 4. Consider Lagrangian system 

/ {uiU2 + q2)dt — > extr (57) 
Jo 

qi = ui, q2 = U2 (58) 

It has factor system 
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/ 1 

/ -v^dt —>■ extr (59) 
y^v (60) 

with the morphism y = uiU2,v = U2 into it. The fixed boundary condi- 
tions qi{0) , q2{0) , qi{T) , q2{T) define a unique trajectory in the original La- 
grangian system. But. when mapped into the factorsystem, they don't pro- 
vide enough information to build the appropriate boundary conditions for the 
factor system. In fact they don't impose any restrictions on the trajectory 
ends at all since the boundary manifolds coincide with the entire space. 

The case of an under-determined factor system does not allow to imme- 
diately benefit from knowing the factorsystem. We still can build a hierarchy 
out of factor- and quotient- systems. Its functioning may rely on a differential 
game with two players: the center (factorsystem) and subordinate (quotient) 
system. The goals of functioning of both players are the same but the nat- 
ural information structure does not allow to achieve the optimum without 
using some additional interaction between the players. A differential games 
resulting from such factorization may resemble situations when the center 
operates in terms that are not directly related to the reality in which the 
subordinate system has to function, even though they share the same goal. 
Thus the practical value of such factorization is less obvious. 

Note that the discussed here factorization of Lagrangian systems can be 
easily generalized to an optimal control problem with free end(s). That 
follows from the locality of the field of extremals. Instead of the boundary 
conditions g(0) = qo,q{T) = qi we will have g(0) — qo,p{T) = 0. That 
change of boundary conditions does not affect any of our constructions. 

Finally we will briefiy touch the case of constrained controls. Since the 
approach we used here is based on smooth objects, any direct generalization 
to the constrained case might me problematic. However in many practical 
cases we can approximate the original constrained optimal control problem 
with a smooth unconstrained one by introducing smooth penalty functions 
to represent constraints. Apparently it could be done in many different ways 
potentially leading to different factorizations or no factorizations at all. 
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9 Conclusion 



In this paper we interpreted order reduction of optimal control systems as 
factorization in the category of Lagrangian systems. We established sufficient 
and necessary conditions of factorization for Lagrangian systems. Factoriza- 
tion can be described in terms of the corresponding Hamiltonian systems 
that appear from Pontryagin's maximum principle. 

Morphisms of Hamiltonian systems that we use in the paper differ from 
the classical. Our definition does not require the mapping into factor system 
to be symplectic. That means that we are not necessarily able to extend it 
to a canonical change of coordinates. Because of that Hamiltonian factor 
systems does not preserve the original symplectic form on the base space. 
Instead the symplectic form in the factor space has to be invariant under 
the fiow of the original Hamiltonian system. This invariance of the sym- 
plectic form gives sufficient and necessary condition of the factorization of 
Hamiltonian systems. Naturally, Hamiltonian of the factor system turns out 
to be first integral of the original Hamiltonian system. Finally, factoriza- 
tion of Hamiltonian system allows to build Lagrangian factor system iff the 
morphism is an observable mapping. Observability here means that the map- 
ping and its Lie derivative along the original Hamiltonian field depends on 
the dual variables only via optimal synthesis functions. 

We discussed factorization of boundary conditions for Lagrangian sys- 
tems. The mapping of the fixed boundary conditions under the factorization 
does not always allow to obtain a well defined boundary condition problem 
for the factor systems. Also we discussed some of the possible interpretations 
of that situation from the point of view of differential games. 
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